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DETAILED ACTION 

1 . This action is responsive to amendment filed 08/26/04. 

2. Claims 1-113 are pending in the application. 

Claim Rejections • 35 USC § 102 

3. The following is a quotation of the appropriate paragraphs of 35 U.S.C. 1 02 that 
form the basis for the rejections under this section made in this Office action: 

A person shall be entitled to a patent unless - 

(e) the invention was described in (1) an application for patent, published under section 122(b), by 
another filed in the United States before the invention by the applicant for patent or (2) a patent 
granted on an application for patent by another filed in the United States before the invention by the 
applicant for patent, except that an international application filed under the treaty defined in section 
351(a) shall have the effects for purposes of this subsection of an application filed in the United States 
only if the international application designated the United States and was published under Article 21(2) 
of such treaty in the English language. 

4. Claims 1-3, 12, 37-40, 43, 44, 53, 78-81 , 86 and 92-95 are rejected under 35 
U.S.C. 102(e) as being anticipated by Goldberg (6,526,158). 

Claim 1 , Goldberg discloses prompting a subject to capture (identifying the 
subject patron 43 whose image to be captured remote subject identification 31; col. 5, 
lines 64-65; fig. 2), using an image capture device (the camera 63 capture an image; 
col. 6, lines 48-51 ), at least one initial body image of the object (an image of the car 45 
and its passenger patron 43; col. 6, lines 49-50; fig. 2); prompting the subject to self 
evaluate an actual condition of the subject's own body (the location of the patron's 43 
face in the frame can be easily established using feature recognition program, and the 
body may be roughly estimated relative to the face... to determine the extent of the 
patron's body; col. 23, lines 53-58); enabling the subject to respond to the prompt and 
enabling the initial body image to be altered based on the subject's response to the 
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prompt, to reflect in the altered image the self-evaluation of the subject (the patron's 
image is altered to place the image of a scar on the patron's cheek, images of earrings 
on his ears... col. Col. 24, lines 12-35). 

Claims 2, 43, 86, Goldberg discloses the image capture device comprises at 
least one of a digital camera, a scanner, a web cam, a camcorder, and a film camera 
(digital camera 63, digital camera 125, camera 157, video camera 235). 

Claims 3, 44, Goldberg discloses instructing the subject to use the image capture 
device (col. 6, line 66 through col. 7, line 1). 

Claims 4, 45, 82, Goldberg discloses the prompt comprises at least one question 
(col. 7, lines 11-22). 

Claims 12, 53, Goldberg discloses the initial body image to be displayed on a 
display device (col. 23, lines 28-38; figs 12a-12e), control elements to be displayed on 
the display device, and enabling activation of the control element to alter portion of the 
image displayed on the display device (col. 24, lines 12-35). 

Claims 37-40, 78-81, 92-95, Goldberg discloses the initial body image having 
fuzzy distortion (col. 24, lines 39-43); the displayed image is altered, based on the 
subject's response to the prompt, to remove the fuzzy distortion (col. 24; lines 36-43). 

Claim Rejections - 35 USC § 103 

5. The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set 
forth in section 102 of this title, if the differences between the subject matter sought to be patented and 
the prior art are such that the subject matter as a whole would have been obvious at the time the 
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invention was made to a person having ordinary skill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was made. 

6. Claims 5-7, 11,13-18, 21-26, 28-31 , 33-36, 41 , 42, 46-48, 52, 54-59, 62-67, 69-72, 
74-77, 83-85, 87-91, 96, 97, 99, 100, 102-104, 107, 109-111 are rejected under 35 
U.S.C. 103(a) as being unpatentable over Goldberg (6,526,158) in view of Hillebrand et 
al. (6,571,003). 

Claims 5, 46, Goldberg does not teach prompt is presented graphically in multiple 
choice; however, Hillebrand et al. discloses the at least one prompt is presented 
graphically in multiple choice form (a graphical comparison; col. 1 1 , lines 4-44; fig. 9). 
Claims 6, 47, Hillebrand et al. discloses prompting the subject (by the controller 200) to 
self-evaluate at least one of skin pigmentation, skin texture, skin sheen, skin tone, skin 
mattiness, skin lines, skin wrinkles, distribution of wrinkles, intensity of wrinkles, 
intensity of pores, depth of pores, color tone, color homogeneity, spots, freckles, 
shininess, oiliness, roughness, distribution of hair, thickness of hair, length of hair, 
density of hair, on the subject's own body (col. 7, line 65 through col. 8, line 10). 
Claims 7, 48, Hillebrand et al. discloses the body image includes a facial image (the 
first digital image of the face of the person; col. 1, lines 53-55), and wherein the prompt 
prompts the subject to self-evaluate characteristics of the subject's own face (col. 1 , 
lines 58-61). Claims 11, 52, Hillebrand et al. discloses the initial body image is a facial 
image (col. 1 , lines 53-55), wherein the actual condition comprises at least one of skin 
pigmentation, skin texture, skin sheen, skin tone, skin mattiness, skin wrinkles, and skin 
lines, wherein the actual condition is located in regions of at least one of the eyes, 
forehead, cheeks, lips, brow, and nose, and wherein the image is altered to reflect the 
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subject's self-evaluation of the actual condition (col. 7, line 65 through col. 8, line 10). 
Claims 13, 54, Hillebrand et al. discloses the actual condition is wrinkles "under eye " 
sub-image; fig. 7) and wherein movement of the control element in a first direction 
causes an increase in the appearance of wrinkles on portion of the image displayed on 
the display device and movement of the control element in a second direction causes a 
decrease in the appearance of wrinkles (under eye sub-image) on portion of the image 
displayed on the display device (col. 7, lines 28-40). Claims 14, 15, 55, 56, 91 , 
Hillebrand et al. discloses the control element comprises first and second control 
elements (using the controller 200, moving the slider control 528 to the right and moving 
the slider control 528 to the left; col. 7, lines 30-37) and the actual condition is wrinkles 
(suppose "under eye" sub-image is wrinkles), wherein activation of the first control 
element causes an increase in the appearance of wrinkles on portion of the image 
displayed on the display device and activation of the second control element causes a 
decrease in the appearance of wrinkles on portion of the image displayed on the display 
device; selectable condition representations to be displayed on the display device, and 
enabling the subject to select at least one of the condition representations (display 
analysis results; col. 10, lines 41-51). Claims 16-18, 57-59, Hillebrand et al. discloses 
prompt is associated with the plurality of selectable condition representations and 
wherein the subject's response to the prompt comprises selection of at least one of the 
representations; enabling the initial body image to be altered comprises enabling the 
initial body image to be altered to include at least one condition representation selected 
by the subject; the plurality of selectable condition representations are caused to be 
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displayed in at least one of a one-by-one fashion and a simultaneous fashion (figs. 10- 
14). Claims 21, 62, Hillebrand et al. discloses displaying portion of the initial body 
image (the first image, and wherein the at least one prompt further prompts the subject 
to compare a portion of the body image displayed on the display device to the subject's 
own body (col. 2, lines 3-13). Claims 22, 63, Hillebrand et al. discloses the subject to 
respond to the prompt comprises enabling the subject to indicate whether a portion of 
the body image displayed on the display device accurately represents the actual 
condition of the subject's own body, and wherein the image to be altered when the 
subject believes a portion of the body image displayed on the display device does not 
accurately represent (each defect area is typically much smaller than the initial image) 
the actual condition (col. 1, lines 53-67). Claims 23, 64, Hillebrand et al. discloses the 
initial body image is an image of at least a portion of the subject's face (col. 1 , lines 53- 
54). Claims 24, 65, Hillebrand et al. discloses the subject to store the altered image 
(col. 2, lines 28-30). Claims 25, 26, 66, 67, Hillebrand et al. discloses the subject to 
receive information about at least one beauty product for treating the actual condition; a 
recommendation to use the at least one beauty product (col. 1, lines 47-50). 
Claims 28-31, 33, 69-72, 74, Hillebrand et al. discloses enabling the subject to 
purchase (to use) beauty product (cosmetic product); the subject to simulate use of 
beauty product on the altered image; the subject to select the at least one beauty 
product; product for treating the actual condition (col. 1 1 , lines 50-64). It would have 
been obvious to one of ordinary skill in the art at the time the invention was made to 
incorporate the skin imaging and analysis systems taught by Hillebrand into the method 
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of altering image of Goldberg for producing current digital image data, because it would 
improve areas is created by electronically of defect areas located in the digital image of 
the face of the person (col. 2, lines 27-30). 

Claims 34-36, 75-77, the rationale provided in the rejection of claims 1 , 7, 1 1 , 12 is 
incorporated herein. 

Claims 41, 42, 96, the rationale provided in the rejection of claims 1 and 7 is 
incorporated herein. 

Claims 83 and 84 are rejected upon the same reasons set forth in claim 1, 12, 21 , 
22, because a method of constructing an image of an external body condition is 
considered as a method of constructing a body image. In addition, Goldberg teaches 
evaluation at least one of color and texture (color value; col. 24, lines 7-9). 

Claim 85, the rationale provided in the rejections of claims 1 ,1 1 , 12 are 
incorporated herein. 

Claims 87-89, Goldberg does not teach identifying bias element; however, 
Hillebrand et al. teaches identifying bias element (skin wrinkles, skin smoothness; col. 8, 
lines 5-8). Claim 90, Hillebrand et al. teaches display analysis results (col. 10, line 41 
through col. 11, line 44). Claim 97, Hillebrand et al. teaches the initial image is present 
in 2D form (fig. 5). Claim 99, Hillebrand et al. teaches transmitting and receiving 
information via network (col. 4, lines 23-35). It would have been obvious to one of 
ordinary skill in the art at the time the invention was made to incorporate identifying bias 
element, display analysis results taught by Hillebrand into the method of altering image 
of Goldberg for producing current digital image data, because displaying the analysis 



Application/Control Number: 10/024,480 Page 8 

Art Unit: 2671 

results (the improved digital image may also be repeatedly alternated to increase 
human comprehension of the simulated improvement (col. 12, lines 38-40). 

Claims 100, 107, Goldberg discloses capturing an image of a body region of the 
subject (the camera 63 captures an image of the car 45 and its passenger patron 43; 
col. 6, lines 49-50); displaying the captured image (col. 6, lines 54-57); comparing a 
color of the displayed image (col. 24, lines 7-9); Goldberg does not teach calibrating the 
color of the image; however, Hillebrand et al. teaches calibrating the color of the image 
when the subject perceives a difference between the displayed image and the actual 
skin color (col. 8, lines 33-67); and simulates use of at least one beauty product on the 
color calibrated image (col. 1 1 , lines 47-64). It would have been obvious to one of 
ordinary skill in the art at the time the invention was made to incorporate the calibrating 
of the color of the image taught by Hillebrand into a facial image recognition and 
modifications of Goldberg's system for producing current digital image data of the 
portion of the portion's skin, because it would create improved areas by electronically 
altering the color of pixels in one of the defect areas located in the first digital image of 
the face of the person (col. 2, lines 27-30). Further, Claims 103, 110, Hillebrand et al. 
discloses places the body region adjacent to the display device and to visually perceive 
whether the color of the displayed image and the actual color of the body region differ 
(color visually distinct from the skin color; col. 8, lines 33-41 ). Claims 1 04, 1 1 1 , 
Hillebrand et al. displaying a plurality of colors (blue, red, green, brown), enabling the 
subject to select one of the displayed colors closest to the actual color of the subject's 
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body region, and enabling alteration of the displayed image to include the selected color 
(col. 8, line 33 through col. 9, line 4). 

Claims 102, 109, Goldberg teaches the image capture device is chosen from a 
digital camera and a scanner (digital cameras 125, 157 (col. 10, line 67; fax machine; 
col. 16, line 2 ). 

7. Claims 8, 49 are rejected under 35 U.S.C. 103(a) as being unpatentable over 
Goldberg (6,526,158) in view of Hillebrand et al. (6,571,003), and further in view of 
Akiba et al. (6,377,745). 

Claims 8, 49, Goldberg does not teach a time-lapse projection of the altered 
image; however, Akiba et al. discloses enabling a subject to view a time-lapse 
projection of the altered image (abstract). It would have been obvious to one of ordinary 
skill in the art at the time the invention was made to incorporate the altered image with a 
lapse-time as taught by Akiba's system into a method of image capture and image 
modifications of Goldberg for producing product characteristics image, because it is 
possible to eliminate display of any unnecessary image such as a commercial to 
consequently realize efficient retrieve of desired video data (col. 4, lines 61-64). 

8. Claims 9, 10, 27, 50, 51, 68 are rejected under 35 U.S.C. 103(a) as being 
unpatentable over Goldberg (6,526,158) in view of Hillebrand et al. (6,571 ,003), Akiba 
et al. (6,377,745) and further in view of Donovan et al. (US Pub. No. 2003/0014324 A1 , 
filed 7/10/01). 

Claims 9, 10, 27, 50, 51, 68, Goldberg does not discloses a time lapse; however, 
Donovan et al. teaches the subject to view a time lapse projection of the altered image 
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based on an assumption of the subject using the at least one beauty product to treat the 
actual condition (paragraph 01 13, page 13). It would have been obvious to one of 
ordinary skill in the art at the time the invention was made to incorporate the time lapse 
as taught by Donovan's system into the method of image capture and image 
modifications of Goldberg for alteration the images, because it would provide 
synthesizing and distributing beauty and personal care products in a retail environment 
(paragraph 007, page 1 ). 

9 Claims 19, 60 are rejected under 35 U.S.C. 103(a) as being unpatentable over 
Goldberg (6,526,158) in view of Hillebrand et al. (6,571 ,003), Akiba et al. (6,377,745) 
and further in view of Filo et al. (6,215,498). 

Claims 19, 60, Goldberg does not teach displaying the select presentation by slide 
show and movie presentation; however, Filo et al. discloses selectable condition 
representations are displayed by means of one of a slide show presentation and a 
movie presentation (col. 20, lines 51-54). It would have been obvious to one of ordinary 
skill in the art at the time the invention was made to incorporate the slide show and 
movie presentation as taught by Filo's system into the method of image capture and 
image modifications of Goldberg for selecting representations of the displayed images, 
because it would display data and information of interest (col. 20, lines 52-53). 
10. Claims 20, 61 are rejected under 35 U.S.C. 103(a) as being unpatentable over 
Goldberg (6,526,158) in view of Hillebrand et al. (6,571,003) and further in view of Wu 
et al. "Skin Aging Estimation by Facial Simulation", IEEE 1999. 



Application/Control Number: 10/024,480 Page 1 1 

Art Unit: 2671 

Claims 20, 61 , Goldberg does not teach varying appearances of wrinkles; 
however, Wu et al. discloses the actual condition comprises wrinkles which are 
representation of varying appearances of wrinkles (section 1. Introduction, page 210). It 
would have been obvious to one of ordinary skill in the art at the time the invention was 
made to incorporate the appearance of wrinkles on the face as taught by Wu's method 
into the facial image of Goldberg for modifying of facial features, because it would 
develop a dynamical wrinkle simulation system (see section 1.1, page 210). 

1 1 . Claims 32, 73 are rejected under 35 U.S.C. 1 03(a) as being unpatentable over 
Goldberg (6,526,158) in view of Hillebrand et al. (6,571,003), and further in view of 
Dirksing etal. (6,516,245). 

Claims 32, 73,Goldberg does not teach makeup product; however, Dirksing et al. 
teaches beauty product (cosmetic product) comprises at least one makeup product 
(lipstick, eyeliner, lotion, powder, mascara; col. 4, lines 39-43). It would have been 
obvious to one of ordinary skill in the art at the time the invention was made to 
incorporate makeup product taught by Dirksing's method into the altering image system 
of Goldberg for producing product characteristics, because it would provide the 
consumer with more privacy and comfort during overall process (col. 4, lines 14-17). 

12. Claims 98, 101, 105, 106, 108, 112 and 113 are rejected under 35 U.S.C. 103(a) 
as being unpatentable over Goldberg (6,526,158) in view of Hillebrand et al. 

(6,571 ,003), and further in view of Hima et al. (EP 1 134701 A2). 

Claim 98, Goldberg does not teach the initial image is present in 3D form; 
however, Hima et al. teaches displaying a user's face in a 3D fashion (col. 1 , lines 32- 
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34); a 3D face model data (col. 3, line 42). It would have been obvious to one of 
ordinary skill in the art at the time the invention was made to incorporate a 3D face 
model image taught by Hima's method into the image recognition system of Goldberg 
for displaying facial image, because it would provide a more realistic beauty simulation 
(col. 1, lines 33-34). 

Claims 101, 105, 108, 112, Goldberg does not teach simulating use of the at least 
one beauty product on predetermined portions of the image. However, Hima et al. 
teaches this feature (col. 7, line 58 through col. 8, line 12); selecting the beauty product 
from a plurality of beauty products and causing a simulation of use of the selected 
beauty product to appear on a region of the color calibrated image (col. 8, line 46 
through col. 9, line 28). It would have been obvious to one of ordinary skill in the art at 
the time the invention was made to incorporate simulating use beauty product on 
predetermined portion of image taught by Hima's method into the altering image system 
of Goldberg for producing product characteristics, because it would provide a more 
realistic beauty simulation (col. 1, lines 33-34). 

Claims 106, 113, Hillebrand et al teaches calibrating the displayed image to 
simulate at least one of an actual skin tone (col. 10, lines 16-40); Hillebrand does not 
teach an actual hair color. However, it would have been obvious to one of ordinary skill 
in the art at the time the invention was made to include a hair color into calibrating the 
displayed image to simulate an actual hair color, because human hair is a part of an 
external human body which includes many desired color that is also a part of beauty 
product. 
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Response to Arguments 

13. Applicant's arguments with respect to claims have been considered but are moot 
in view of the new ground(s) of rejection. 

The rejections of claims 1-113 have been modified in this Office Action. 
Goldberg teaches capture body image (patron) of the subject and enabling the body 
image to be altered based on the subject's response to the prompt (subject 
identification) and reflect in the altered image the self-evaluation; Goldberg also teaches 
facial recognition (image of the face), comparing color values (self-evaluation) and 
alters the images to provide image modification. The details of skin imaging and 
analysis have been incorporate by the teachings of Hillerbrand, both main references of 
Goldberg and Hillerbrand disclosed the same methods: using digital images from an 
image captured device (Goldberg teaches using cameras to capture image), self- 
evaluation images and altered images to provide image enhancement (see the Office 
Action). 

14. Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Kimbinh Nguyen whose telephone number is (703) 
305-9683. The examiner can normally be reached (Monday- Thursday from 7:00 AM 
to 4:30 PM and alternate Fridays from 7:00 AM to 3:30 PM). 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Mark Zimmerman, can be reached at (703) 305-9798. 

Any response to this action should be mailed to: 
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Commissioner of Patents and Trademarks 
Washington, D.C. 20231 
Or faxed to: 

(703) 872-9314 (for Technology Center 2600 only) 

Hand-delivered responses should be brought to Crystal Part II, 2121 Crystal Drive, 
Arlington, VA, Sixth Floor (Receptionist). 

Any inquiry of a general nature or relating to the status of this application or 
proceeding should be directed to the Technology Center 2600 Customer Service Office 
whose telephone number is (703) 306-0377. 

Information regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for 
published applications may be obtained from either Private PAIR or Public PAIR. 
Status information for unpublished applications is available through Private PAIR only. 
For more information about the PAIR system, see http://pair-direct.uspto.gov. Should 
you have questions on access to the Private PAIR system, contact the Electronic 
Business Center (EBC) at 866-21 7-91 97 (toll-free). 



January 19, 2005 




Kimbinh Nguyen 



Patent Examiner AU 2671 



